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Abstract 


Image  smoothing  and  segmentation  algorithms  are  frequently  formulated  as  optimization 
problems.  Linear  and  nonlinear  (reciprocal)  resistive  networks  have  solutions  characterized 
by  an  extremum  principle.  Thus,  appropriately  designed  networks  can  automatically  solve 
certain  smoothing  and  segmentation  problems  in  robot  vision.  This  paper  considers 
switched  linear  resistive  networks  and  nonlinear  resistive  networks  for  such  tasks.  A  new 
derivation  of  the  latter  network  type  from  the  former  is  given  via  an  intermediate  stochastic 
formulation,  and  a  new  result  relating  the  solution  sets  of  the  two  is  given  for  the  “zero 
temperature”  limit.  We  then  present  simulation  studies  of  several  continuation  methods 
that  can  be  gracefully  implemented  in  analog  VLSI  and  that  seem  to  give  YgoodV  results  for 
these  non-convex  optimization  problems.  .  y ?■ 
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ABSTRACT 

Image  smoothing  and  segmentation  algorithms  are  fre¬ 
quently  formulated  as  optimization  problems.  Linear  and  non¬ 
linear  (reciprocal)  resistive  networks  have  solutions  character¬ 
ized  by  an  extremum  principle.  Thus,  appropriately  designed 
networks  can  automatically  solve  certain  smoothing  and  seg¬ 
mentation  problems  in  robot  vision.  This  paper  considers 
switched  linear  resistive  networks  and  nonlinear  resistive  net¬ 
works  for  such  tasks.  A  new  derivation  of  the  latter  network 
type  from  the  former  is  given  via  an  intermediate  stochastic 
formulation,  and  a  new  result  relating  the  solution  sets  of  the 
two  is  given  for  the  “zero  temperature’’  limit.  We  then  present 
simulation  studies  of  several  continuation  methods  that  can  be 
gracefully  implemented  in  analog  VLSI  and  that  seem  to  give 
“good”  results  for  these  non-convex  optimisation  problems. 

1  Introduction 

One  of  the  most  important,  yet  most  difficult,  early  vision 
tasks  is  that  of  image  smoothing  and  segmentation.  Smooth¬ 
ing  is  necessary  to  remove  noise  from  an  input  image  so 
that  reliable  processing  in  subsequent  stages  is  facilitated. 
However,  indiscriminate  smoothing  will  blur  the  entire  im¬ 
age,  including  edges  (corresponding  to  object  boundaries) 
which  are  necessary  for  later  stages  of  processing.  Many 
.researchers  are  currently  seeking  to  develop  algorithms  that 
smooth  in  a  piecewise  manner,  respecting  edges.  There  are 
two  main  approaches  taken  —  stochastic,  [Geman  k  Geman], 
[Marroquin],  [Cohen],  and  deterministic  [Blake  k  Zisserman], 
[Blake],  [Perona  k  Malik].  The  former  relies  on  such  methods 
as  simulated  annealing  to  accomplish  the  minimization.  The 
deterministic  approach,  on  the  other  hand,  relies  on  the  ap¬ 
plication  of  continuation  methods  [Ortega  k  Rheinboldt]  to 
certain  nonlinear  systems,  or  in  the  case  of  [Koch  et  oi],  on 
using  a  neural  network  similar  to  that  of  Hopfield  and  Tank 
[Tank  k  Hopfleld]. 

Although  efficient  computation  techniques  exist  for  nu¬ 
merically  computing  the  solutions  to  vision  problems 
[Terzopouloe],  even  the  fastest  algorithms  running  on  a  par¬ 
allel  supercomputer  (such  as  the  Connection  Machine  [HiUis]) 
do  not  approach  real-time  performance.  The  motivation  of 
this  work  is  to  produce  solutions  to  the  smoothing  and  seg¬ 
mentation  problem  that  are  amenable  to  analog  VLSI  network 
implementation  [Koch  et  ai],  [Poggio  k  Koch],  [Horn]. 

The  outline  of  the  paper  is  as  follows.  In  Section  2,  we 
present  the  smoothing  and  segmentation  task  as  a  minimiza¬ 
tion  problem.  In  Section  3,  we  present  methods  for  solving  the 
minimisation  problem  and  discuss  network  implementations  of 


these  methods.  Simulation  results  are  provided  in  Section  4 
and  the  conclusion  is  given  in  Section  5. 

2  Minimization 

The  difficulty  with  using  a  linear  network  for  image  smooth¬ 
ing  is  that  noise  and  signal  are  equally  smoothed  so  that  edges 
become  blurred.  We  therefore  seek  a  method  for  segmenting 
the  signal  into  regions  which  can  be  smoothed  separately.  One 
technique  for  doing  this  is  to  introduce  a  line  process  (i.e.,  a 
set  of  binary  variables)  which  selectively  breaks  the  smooth¬ 
ness  constraint  at  given  locations.  This  method  appears 
widely  in  the  literature,  e.g.,  [Geman  k  Geman],  [Koch  et  ai], 
[Marroquin],  and  [Marroquin  et  ai]. 

For  simplicity  of  notation,  all  equations  in  this  paper  are 
formulated  for  the  one-dimensional  case.  The  results  general¬ 
ise  trivially  to  two  dimensions,  and  the  simulation  results  are 
for  the  two-dimensional  case. 

The  smoothing  and  segmentation  problem  with  the  line  pro¬ 
cess  can  be  treated  as  a  minimization  problem.  Let  u  €  K‘V  be 
the  input  image,  y  €  be  the  output  image,  and  1  6  1 

be  the  line  process,  where  the  line  process  variable  /,  as¬ 
sumes  the  values  {0, 1}  depending  on  whether  the  smoothness 
penalty  between  nodes  »  and  « ■+• 1  is  enforced  or  not.  Consider 
the  following  cost  function: 

J{  y,  l|u)  =  j  [F(y|u)  +  S(y,  1)  + 1(1)1  ( D 

where  F,  S,  and  L  are  the  “fidelity,”  “smoothness,”  and  “line” 
penalty  terms,  respectively,  i.e., 

N 

F(y|u)  =  A,  £(!«-«<)*  (2) 

imi 

iV-t 

S(y,l)  =  A,  (yi  -  y<+i)J(l  -  li)  (3) 
•«1 

1(1)  =  A  (4) 

•at 

The  expression  (1)  can  be  minimized  with  respect  to  y  for 
fixed  1  by  differentiating  with  respect  to  each  y<  and  setting 
the  derivatives  to  zero.  This  produces  the  following  system  of 
equations: 

A/(y<  -  u<)  +  A,(y<  -  y<-i)(l  ~/»-i)  +  A,(y<  —  y«+i)(l  -  h)  —  0. 

(5) 

with  appropriate  modifications  at  the  boundaries  i  =  1  and 
i  =  N.  Notice  that  (5)  can  be  viewed  as  the  KCL  relation  at 
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Figure  1:  A  simple  smoothing  network  with  switches.  The 
vertical  and  horizontal  resistors  have  conductances  A /  and  A(l 
respectively. 


every  node  of  a  resistive  ladder  in  which  the  horizontal  resis¬ 
tive  elements  have  switches  (corresponding  to  a  line  process 
element)  associated  with  them.  A  network  for  computing  y 
given  1  is  shown  in  Figure  1;  similar  networks  have  appeared  in 
[Koch  et  ai]  and  [Marroquin  et  a/].  This  type  of  network  will 
be  referred  to  as  a  resistor-with-switch  (or  RWS)  network.  For 
any  setting  of  the  switches,  the  network  will  minimize  the  coat 
function  with  respect  to  y.  The  difficulty  is  in  minimizing  with 
respect  to  1,  because  the  network  solution  can  be  any  one  of  a 
number  of  local  minima. 

Much  has  been  said  in  the  literature  in  regard  to  finding  a 
global  minimum  to  (1)  by  stochastic  and  deterministic  meth¬ 
ods.  These  techniques  are  necessary  to  find  the  minimizing 
1  —  minimizing  with  respect  to  y  given  1  only  requires  the 
solution  of  a  linear  system.  The  deterministic  approaches  rely 
on  the  fact  that  the  minimization  problem  can  be  recast  into 
one  in  which  the  line  process  variables  have  been'eliminated. 
The  latter  will  be  studied  here  since  they  appear  to  lead  to 
-practical  VLSI  implementations. 


2.1  Resistive  Fuse  Elements 


The  line  process  variables  can  be  removed  from  (1)  by  straight¬ 
forward  algebraic  manipulations.  In  fact,  Blake  and  Zisserman 
demonstrated  that  the  original  cost  function  J(y,  l|u)  contain¬ 
ing  real  and  boolean  variables  is  intimately  related  to  the  fol¬ 
lowing  cost  function  containing  only  real  variables: 


*(y|u)  i  i 
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+  ^  G( IK-lK+l)  . 
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where 


The  line  process  is  found 


A.va,  |«|  <  \f& 

Af,  otherwise 

s  posteriori  according  to: 


0, 

1, 


|y<  -  Vt+il  <  \/E 
otherwise 


(6) 

(7) 


(8) 


Note  that  if  is  a  son-convex  cost  function  with  respect  to  y. 

Apart  from  instances  in  which  solutions  occur  at  points 
where  G  is  not  differentiable,  the  minimum  of  if  is  to  be  found 
among  those  points  where  Vif(y|u)  =0,  i.e., 


~  «0  +  9iUi  ~Vi-i)  +  3iV(  ~  V<+0  *  0,  (9) 

where  g{v)  as  \{;G(v). 

Equation  (9)  can  also  be  viewed  as  the  KCL  relation  at 
each  node  of  a  nonlinear  resistive  network  with  the  topology 


Figure  3:  Characteristic  of  the  discontinuous  nonlinear  resistor 
known  as  a  “resistive  fuse.”  The  dotted  vertical  lines  are  not 
part  of  the  constitutive  relation. 


illustrated  in  Figure  2.  The  nonlinear  resistor  characteristic. 
g(v),  is  that  of  a  linear  resistor  that  becomes  an  open  cir¬ 
cuit  when  the  voltage  across  it  exceeds  a  certain  threshold, 
as  shown  in  Figure  3.  Then,  in  electrical  terms,  G  is  twice 
the  co- content  function  for  this  nonlinear  resistor  [Millar],  i.e., 
G(v)  =  2  /g  g( u)  du.  An  element  with  this  type  of  behavior  is 
sometimes  called  a  resistive  fast  and  has  actually  been  imple¬ 
mented  in  analog  VLSI  [Harris  et  ai).  A  network  incorporating 
resistive  fuses  will  be  referred  to  as  an  RWF  network,  i.e.,  a 
resistor- with- fuse  network. 

For  a  given  cost  function,  one  can  construct  correspond¬ 
ing  RWS  and  RWF  networks.  For  every  solution  of  an  RWF 
network,  there  exists  a  similar  solution  to  the  corresponding 
RWS  network,  but  there  are  switch  configurations  of  an  RWS 
network  for  which  there  is  no  corresponding  solution  in  a  cor¬ 
responding  RWF  network.  The  question  then  arises  whether 
restricting  attention  to  the  RWF  network  might  cause  one  to 
overlook  a  solution  to  the  RWS  network  that  is  in  fact  the 
global  minimum.  The  answer  is  no,  by  the  following  proposi¬ 
tion: 

Proposition  1  Consider  a  cost  function  J(y,  l|u)  as  specified 
in  (1)  and  the  corresponding  RWS  and  RWF  networks  speci¬ 
fied  by  (5)  and  (9).  If  a  solution  y*  exists  for  the  RWS  network 
which  is  not  also  a  solution  to  the  RWF  network,  then  y*  is 
set  a  local  minimum  to  J,  meaning  that  changing  the  setting 
of  a  single  (appropriately  selected)  switch  in  the  RWS  network* 
will  produce  a  new  solution  (with  a  new  value  of  y)  for  which 
the  value  of  J  is  strictly  lower. 

In  order  to  complete  the  proof,  we  need  the  following  lemma: 


Lemma  1  (Local  Measurement  Principle)  Consider  a 
one-dimensional  or  two-dimensional  network  of  the  type  shown 
in  Figure  1,  in  which  an  arbitrary  number  of  switches  (>  1) 
are  open.  Let  us  consider  the  change  in  the  power  dissipated 
in  the  network 

y  y-i 

P  =  A/ £(y,- -  u<)J  +  A. 

,»l  i3*  1 

=  2  (F+S)  (10) 

caused  by  closing  a  single  switch.  Let  P~  be  the  value  of  P 
with  the  switch  open,  P+  be  the  value  of  P  with  the  switch 
closed,  and  define  AP  =  P*  —  P~ .  Let  i„  be  the  current 
through  the  switch  when  it  is  closed  and  let  v„  be  the  voltage 
across  the  switch  when  it  is  opened  (after  the  network  has 
settled).  Then  the  increase  in  dissipation  which  results  from 
closing  the  switch  is 

AP  =  vMi,e  >  0.  (11) 

Remark:  This  is  a  startling  result.  The  local  measurement 
principle  implies  that  one  can  measure  the  global  change  in 
the  network  cost  function  due  to  a  switch  change  merely  by 
taking  two  measurements  at  the  switch.  Both  proofs  below 
use  circuit  theory  techniques,  but  can  also  be  carried  out,  al¬ 
beit  laboriously,  by  mathematical  arguments  divorced  from  a 
network  realization,  e.g.,  the  proof  of  Lemma  1  via  a  rank  1 
perturbation  method  in  [Elfadel]. 

Proof  of  Lemma  1:  Define  and  to  be  the  network 
branch  voltages  and  currents  when  the  switch  is  open.  Define 
vi  and  it  to  be  the  network  branch  voltages  and  branch  cur¬ 
rents  when  the  switch  is  closed.  Define  Au*'=  vt  —  »t  and 
Ait  =  it  -  «7  •  By  Tellegen’s  theorem  [Penfield  el  of), 

53  [w*A«t  -  it  Act]  as  0.  (12) 

•a 

kitasba 

Group  the  terms  in  (12)  according  to  branch  element,  and  note 
that 

53[utAit-itAut]  +  £  [vtAit  -  iiAvt]  (13) 

M«r«ts 

+  ^  [v* —  tjfcAvfc]  +  vjwAtjw  —  i*sw Avsw  =  0» 

iwitthes 

where  the  subscript  “sw”  refers  to  the  switch  that  is  being 
cloeed  and  “fixed  switches”  to  all  others.  To  simplify  (13), 
note  that  Aut  =  0  for  the  voltage  sources,  vt  and  Avt  vanish 
for  closed  switches,  it  and  Ait  vanish  for  open  switches,  and 
for  the  resistors: 

»t  Ait  -  it  At»t  ss  r?t»t Ait  -  it/ZtAit  =  0.  (14) 

Equation  (13)  then  becomes 

0  =  5Z  +  VswAigw  —  iswAosw 

veftase 

Msnss 

=  $3  +  vsw(isw  -  ijW)  -  isw(vsw  -  «sw) 

*eiun 

HtNtl 

=  53  (vtAit]  +  »jWiSw  (15) 

*tiUn 

MIHM 

The  summation  term  in  (15)  is  just  the  change  in  power  deliv¬ 
ered  to  the  network,  i.e.,  -A P,  and  vjw*sw  =  v«i,e.  There¬ 
fore, 

A  P  =  »*.«„.  (15) 
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Figure  4:  Load-Line  diagram  for  RWS  network  and  RWS  net¬ 
work  with  resistive  fuse  substituted  for  one  resistor-switch 
composite  element.  The  dashed  lines  A,  B,  and  C  are  pos¬ 
sible  load-lines  representing  the  behavior  of  an  RWS  network 
as  seen  by  one  resistor-switch  pair.  The  six  marked  points 
indicate  possible  solutions,  depending  on  switch  position.  If 
a  resistive  fuse  element  (with  characteristic  i  =  g(v),  shown 
with  a  solid  line)  is  substituted  for  the  resistor-switch  pair, 
the  four  circled  solutions  remain,  while  the  solutions  marked 
X  and  W  disappear. 

Proof  of  Proposition  1:  Consider  any  RWS  network  with 
any  input  u,  switch  configuration  L  and  corresponding  net¬ 
work  solution  y*,  such  that  y*  is  not  a  solution  of  the  corre¬ 
sponding  RWF  network.  Then  there  must  exist  some  resistor- 
switch  composite  element  (element  q,  say),  such  that  y*  is 
no  longer  a  network  solution  if  a  resistive  fuse  is  substituted 
in  its  place.  Make  such  a  substitution  and  then  consider  the 
load-line  describing  the  remainder  of  the  linear  RWS  network 
as  seen  from  this  location.  The  two  possible  cases  marked  in 
Figure  4  are  Case  X,  in  which  switch  q  was  open  in  the  origi¬ 
nal  RWS  network,  and  Case  W,  in  which  switch  q  was  closed. 
Note  that  the  area  in  the  first  quadrant  under  the  triangle  is 
^Af.  In  Case  X.  dosing  the  switch  in  the  original  RWS  net¬ 
work  would  have  caused  the  solution  to  move  to  the  circled 
point  on  line  A.  By  Lemma  1  the  change  would  be 

Jcl »t*4  Jop*n  —  2 1^®*1**  —  A|]  <  0,  (17) 

where  the  inequality  follows  from  the  fact  that  (the 

area  under  the  line  connecting  the  origin  to  (vM,  i,s))  is  less 
than  ^A|  (the  area  under  the  triangle).  For  Case  W,  similar 
reasoning  shows  J^,n-Jcio>'4  <  0  if  opening  the  switch  causes 
the  network  solution  to  move  horn  point  W  to  the  circled  point 
on  line  C.  Thus  points  X  and  W  in  Figure  4  are  not  local 
minima  of  J.  I 

Remark:  The  converse  of  the  proposition  is  not  true.  If  the 
network  solution  lies  on  load-line  B,  one  intersection  point  or 
the  other  will  generally  have  lower  cost  for  the  RWS  network, 
yet  both  are  valid  solutions  to  the  RWF  network. 

2.2  Marginal  Distribution  of  Reconstructed 
Intensities  in  a  Stochastic  Formulation 

There  is  an  alternate  method  for  deriving  the  RWF  network 
from  the  RWS  network:  calculating  the  marginal  distribution 
of  reconstructed  intensities  in  a  stochastic  formulation.  In  this 


*  approach,  one  postulate*  that  the  e  posteriori  joint  probability 
distribution  for  y  and  1  given  u  is  of  the  Gibbs  form 

(18) 

where  ci  is  a  normalising  constant,  and  F,  5,  and  L  are  given 
in  (2)  -  (4).  The  marginal  a  posteriori  distribution  of  y  is 
obtained  in  the  usual  way: 

p(y)  »  2>r.i) 

1<C 

Cl  ^  e-Wyiu)+s(y,l)+£(l)i  (19) 
lac 

where  C  is  the  set  of  all  corners  of  the  unit  (N—  l)-dimensional 
hypercube. 

A  useful  closed  form  expression  for  p(y)  appears  below: 
Lemma  2 

p(y)  =  c,,-«WWW  (20) 

where  cj  is  a  normalising  constant,  F(y|u)  is  given  in  (2),  and 

My)  ~  p  ZI  10  (l +  «-»[*, -a.Om-s***)1])  •  (21) 

The  proof  of  the  lemma  requires  the  following  fact,  which 
can  easily  be  verified. 

Fact:  Let  b  =  (&i, . . . ,  4n)  be  a  vector  of  n  binary  variables, 
64  €  (0, 1},  and  let  C  be  the  set  of  ail  such  vectors.  Then  for 
any  r  6  »*, 

£eb-r»f[(l  +  er*),  (22) 

bee  <-» . 

where  b  •  r  is  the  standard  inner  product. 

Proof  of  Lemma  2:  (It’s  only  algebra) 

The  terms  being  summed  in  (19)  can  be  decomposed  as 
follows: 


x  (23) 

Using  22,  the  term  in  braces  sums  to 

exp  E  ln<1  +  e-*A,-A*(»‘-»*‘)al)}  j  (24) 

and  further  algebraic  manipulation  shows  that 

p(y)  =  Cle-**yi«>+/.(y)l(  (25) 

where 

/,(y)  =  +(iV“1)A»*  (“) 

Absorbing  an  additive  term  into  the  normalising  constant  ej, 
the  lemma  was  stated  in  (21)  in  terms  of 

My)  =  My)  +  [ln(l  +  e*A')  -  0X,\ ,  (27) 

which  is  constructed  so  that  /j(0)  »  0.  This  is  a  necessary 
step  if  we  are  to  later  interpret  My) u  the  co-content  function 
of  a  set  of  nonlinear  resistors.  I 


Remark:  Equation  (20)  suggests  a  new  cost  function 

ffs(y|«)  =  j[^(y|»»)  +  Ja(y)].  '  (28) 

The  minima  of  tfs(y|u)  are  obtained  from  the  set  of  points 
satisfying 

Vtf*(yiu)  =  0.  (29) 

Talcing  the  i-th  component  of  (29)  gives: 

■Mih.-  u»)  +  9t(tn  -  y<-i)  +  9o(vi  -  y«+i)  =  0,  (30) 

where 

Mv)  ~  1  +  e-d(A1-A.»,l'  (31) 

Equation  (30)  can  be  considered  the  KCL  relation  at  each  node 
of  a  nonlinear  network  having  vertical  linear  resistive  elements 
with  conductance  A  /  and  horisontal  nonlinear  elements  with 
constitutive  relation  :  =  gg(v).  In  this  case,  As(y|u)  is  the 
total  co-content  of  the  network.  Notice  that  as  0  —  oo,  we  re¬ 
cover  the  RWF  network,  Le.,  /f«,(ylu)  =  /C(y|u).  Moreover, 
we  have  defined  a  family  of  /3-dependent  resistive  elements, 
illustrated  in  Figure  8,  that  can  be  used  in  continuation  meth¬ 
ods. 

The  expressions  (26)  and  (31)  have  also  been  obtained 
from  the  RWS  network  by  a  somewhat  different  stochastic 
method  involving  repeated  use  of  the  mean-field  approxima¬ 
tion  [Geiger  ic  Girosi].  No  approximations  are  involved  in  the 
marginal  density  formulation  above. 


3  Solution  Methods  and  Network 
Implementations 

The  resistive  fuse  and  marginal  distribution  approaches  pro¬ 
duced  switch-free  nonlinear  networks  with  identical  topologies 
(see  Figure  2)  but  with  different  constitutive  relations  for  the 
nonlinear  elements.  For  either  network,  multiple  solutions  gen-, 
erally  exist.  On  the  theoretical  side  this  is  a  difficulty  because 
we  are  trying  to  find  the  global  minimum  of  a  specific  cost 
function.  On  the  practical  side  this  is  a  difficulty  because  the 
solution  that  is  obtained  by  a  physical  network  realization  will 
depend  strongly  on  such  things  as  parasitic  capacitances  and 
other  characteristics  of  the  network  over  which  we  have  little 
eontroL  We  therefore  seek  some  modification  of  the  network 
that  will  allow  us  to  exercise  some  control  over  the  solution  it 
finds.  In  this  section,  we  apply  continuation  methods  to  the 
nonlinear  smoothing  and  segmentation  networks. 


3.1  Example  —  A  Special  Case 


The  simplest  special  case  that  nonetheless  provides  insight  into 
the  phenomenon  of  multiple  solutions  is  the  response  of  a  one¬ 
dimensional  network  to  a  step  edge  input,  i.e., 


i  <  k 
■i>  k 


(32) 


for  some  k  <  iV.  This  corresponds  to  a  step  of  u»  -  >  0 

between  nodes  k  and  k  +  1  and  serves  as  a  model  for  the 
simplest  two-dimensional  edge,  i.e.,  a  step  that  extends  across 
the  entire  network  and  is  parallel  to  one  of  the  network  ‘‘axes’,  e 
For  the  step  input  described  above,  the  one-dimensional  net¬ 
work  has  a  simple  circuit  equivalent,  shown  in  Figure  5.  The 
simplification  proceeds  as  follows.  First,  we  assume  that  the 
signal  is  ‘‘well-smoothed”  on  either  side  of  the  step  so  that 


Figure  5:  Thevenin  equivalent  circuit  for  nonlinear  smoothing 
and  segmentation  network  with  step  input. 


each  nonlinear  element  can  be  replaced  by  an  equivalent  lin¬ 
ear  resistance  whose  value  is  the  incremental  resistance  of  the 
nonlinear  element  about  zero  volts.  The  network  elements  on 
either  side  of  the  step  are  then  replaced  by  their  Thevenin 
equivalents,  which  are  combined  into  a  single  linear  element 
and  voltage  source.  The  simplified  network  will  be  referred  to 
as  the  zero-dimensional  case.  Analysis  of  the  behavior  of  the 
network  to  a  step  input  is  reduced  to  solving  the  KCL  equa¬ 
tion  at  one  node:  some  insight  into  the  circuit  behavior  can 
be  gained  by  using  load-line  techniques  (see  Figure  4  -  Figure 

7). 

This  “linear  load-line  assumption”  holds  exactly  only  for  the 
RWS  network  with  fixed  switch  positions  and  for  the  marginal 
distribution  network  with  /?  =  0.  For  the  RWF  network  and 
for  the  marginal  distribution  network  with  0  — ►  oo,  it  is  exact 
over  the  limited  voltage  range  in  which  no  new  discontinuities 
are  introduced  into  y.  Otherwise,  it  is  only  an  approxima¬ 
tion  and  its  applicability  to  other  cases  of  interest  must  be 
individually  determined. 


3.2  Continuation  Methods 

We  seek  a  modification  to  the  networks  so  that  the  solution  will 
be  repeatable  and  also  be  visually  and  quantitatively  “good.” 
One  technique  that  works  well  within  the  context  of  smoothing 
and  segmentation  is  to  apply  a  continuation  method  to  the 
network  [Ortega  k  Rheinboldt]. 

A  continuation  (sometimes  called  “deterministic  anneal¬ 
ing”)  can  be  realized  in  network  form  by  the  simultaneous 
application  of  a  given  homotopy  (continuous  deformation)  to 
some  or  all  of  the  circuit  elements.  Two  types  of  continua¬ 
tions  are  particularly  appropriate  for  our  class  of  nonlinear  net¬ 
works.  Assume  we  have  a  network  with  horizontal  nonlinear 
resistors  whose  constitutive  relation  is  described  by  i  =  g(v), 
and  vertical  linear  resistors  with  conductance  A/.  Consider 
the  following  two  homotopies  for  the  horizontal  and  vertical 
elements,  respectively: 

CH:  Replace  g(v)  with  g^p\v),  p  €  [a,  4),  such  that  gW  con. 
strains  the  network  to  have  a  unique  solution  and  that 
^‘’(s)  =  g(v)-, 

CV:  Replace  A/  with  Ajf\  p€  (a,  4],  such  that  A^  constrains 
the  network  to  have  a  unique  solution  and  that  A^  =  A/. 

Note  that  CH  and  CV  define  when  the  homotopies  are  ap¬ 
plied  in  the  network  to  produce  a  continuation;  we  are  still 
free  to  decide  the  specific  form  of  the  homotopy. 


»!•* 


Figure  6:  Approximate  load-line  plot  for  marginal  distribution 
network  with  ^-Continuation.  The  lines  with  negative  slope 
represent  the  load-lines  for  two  different  input  values  (0.5  V 
and  2.5  V).  The  nonlinear  resistor  is  shown  for  various  values 
of  0.  For  0  a  0,  the  nonlinear  resistor  acts  as  a  linear  resistor. 
As  0  — *  oo,  the  nonlinear  resistor  characteristic  becomes  that 
of  the  RWF. 

3.3  /3-Continuation 

Blake  and  Zisserman  suggest  a  CH  continuation  method  — 
the  so-called  “graduated  non-convexity”  algorithm,  or  GNC. 
There  are  several  apparent  weaknesses  to  using  the  GNC  al¬ 
gorithm  in  network  form,  however.  First,  there  is  no  reason 
to  expect  that  the  specific  continuation  used  by  GNC  will 
produce  the  global  minimum  or  that  it  will  even  produce  a 
“good”  minimum.  Second,  and  more  importantly,  the  initial 
state*(i.e.,  the  initial  value  of  the  continuation  parameter)  of 
the  network  realization  of  GNC  is  not  guaranteed  to  have  a 
unique  solution. 

On  the  other  hand,  the  marginal  distribution  derivation  of 
our  nonlinear  network  provides  a  natural  homotopy  for  real¬ 
ization  of  the  CH  continuation.  For  0  =  0,  the  network  with 
elements  described  by  (31)  is  linear,  whereas  for  0  =  oo,  the 
elements  become  identical  to  those  in  Figure  3  and  will  (lo¬ 
cally)  solve  our  minimization  problem.  This  suggests  using  0 
directly  as  the  continuation  parameter  for  a  CH  continuation 
for  solving  (30)  and  hence  (9).  Furthermore,  because  of  the 
way  this  continuation  was  derived,  one  might  expect  that  it 
would  do  a  good  job  of  seeking  the  global  cost  minimum. 

Some  insight  into  the  behavior  of  this  type  of  network  can 
be  gained  by  examining  the  zero-dimensional  case.  Figure  6 
shows  the  marginal  distribution  nonlinear  resistor  characteris¬ 
tic  for  various  values  of  0,  along  with  two  load-lines  represent¬ 
ing  two  different  values  of  the  input.  As  0  is  taken  from  0  to 
oo,  the  solution  will  follow  the  continuous  path  represented  by 
the  intersection  of  the  resistor  curve  and  the  load-line.  In  this 
example,  the  smaller  step  will  be  smoothed,  and  the  larger 
step  will  be  segmented. 

3.4  A/-Continuation 

The  CV  continuation  can  be  realized  in  a  straightforward 
manner  by  performing  a  homotopy  on  the  vertical  resistors  in* 
the  network.  In  particular,  we  begin  with  the  resistors  having 
infinite  (or  sufficiently  large)  conductance  so  that  the  network 
has  only  one  solution,  namely  y  =  u  (or  y  as  u).  Then,  we 
continuously  decrease  the  value  of  the  conductance  to  A/. 


u 


Figure  7:  Approximate  load-line  plot  for  Ay-continuation. 
Two  seta  of  load-lines  are  shown,  each  set  for  a  different  value 
of  the  input  (the  load-lines  intersect  the  g(v)  =  0  line  at  the 
value  of  the  input  voltage  —  0.5  V  and  2.5  V).  As  Ay  is  de¬ 
creased,  the  load-lines  rotate  counter-clockwise. 


Examination  of  the  zero-dimensional  case  provides  some 
insight  into  the  behavior  of  this  type  of  network.  Figure  7 
shows  the  marginal  distribution  nonlinear  resistor  character¬ 
istic  for  large  0,  along  with  two  sequences  of  load-lines  repre¬ 
senting  two  different  values  of  the  input.  As  is  taken  from 

A(y**  s  A0  to  s  Ay,  the  solution  will  follow  the  continu¬ 
ous  path  represented  by  the  intersection  of  the  resistor  curve 
and  the  load-line.  In  this  example,  the  smaller  step  will  be 
smoothed,  and  the  larger  step  will  be  segmented. 

3.5  Dynamic  Solution 

There  is  one  final  method  for  minimising  (28)  and  realising 
(30)  as  a  network:  embed  the  static  network  into  a  dynamic 
one  so  that  (28)  is  a  Liapunov  function  of  the  dynamic  net¬ 
work.  We  do  this  by  adding  a  fixed  value  linear  capacitor  to 
ground  at  each  node  of  the  network  (see  Figure  8).  This  gives 

d 

C 3tV<  =  “  u<)  +  9^Vi  ~  y<~‘) +  9^Vi  ~  y,+^  ^ 

as  the  KCL  relationship  at  each  node  of  the  network.  At 
the  final  state  of  the  network,  J^-y  =  0,  which  is  precisely 
what  we  want.  We  still  need  to  specify  the  initial  condition 
and  there  are  two  that  are  interesting,  namely  y(0)  =  0  and 
y(0)  s  u.  It  can  easily  be  shown  that  the  network  always 
settles  to  equilibrium  for  any  initial  condition  and  for  any  fixed 
set  of  parameters. 

Note  that  for  values  of  0  <  oo,  and  for  y(0)  a  u,  this  net¬ 
work  is  essentially  a  modified  form  of  the  one  presented  in 
[Perona  k  Malik].  This  network  has  an  advantage  over  that 
presented  in  [Perona  k  Malik],  however  it  settles  to  a  non- 
trivin!  equilibrium  point  that  (at  least  locally)  minimizes  a 
specified  cost  function. 


4  Numerical  Experiments 

Our  goals  in  this  section  are  two-fold:  to  measure  how  well  the 
networks  actually  minimize  the  cost  function  given  in  (1)  and 
to  qualitatively  observe  how  the  networks  smooth  and  segment 
images. 


Figure  9:  Input  image  used  for  experiments. 


Figure  10:  Input  image  with  additive  noise. 


The  experiments  were  all  conducted  on  16  x  16  two- 
dimensional  grids.  Figure  9  shows  the  synthetic  image  used  for 
the  experiments.  The  small  step  is  1 V  in  height  and  the  large 
step  is  3  V.  The  original  image  was  then  corrupted  by  the 
addition  of  0.5  V  of  uniformly  distributed  noise  and  is  shown 
in  Figure  10.  The  noisy  signal  was  used  as  input  for  all  exper¬ 
iments. 

The  results  of  three  experiments  are  included  here.  For 
each  experiment,  a  cost  ftinction  was  determined,  and  the 
^-continuation,  Ay-continuation,  and  dynamic  networks  weres  - 
constructed  according  to  the  cost  function.  Then,  the  net¬ 
works  were  each  simulated  using  the  input  image  shown  in 
Figure  10  (for  the  dynamic  network,  the  initial  conditions 
y(0)  a  0  and  y(0)  =  u  were  both  tested).  In  order  to  es- 


Experiment 

Parameter 

X/  X9  X/ 

Expt  1 

1.0  X  10“**  1.0  x  10“ J  1.0  x  10— 

Expt  2 

1.0  x  10—  1.0  x  10—  2.5  x  10— 

Expt  3 

3.0  x  10“*  1.0  x  10—  5.0  x  10-* 

Table  1:  Parameter  values  for  three  experiments. 


Network 

Cost 

Expt  1  Expt  2  Expt  3 

Anneal 

1.187x10-'  1259x10-*  4.129x10— 

/3-Cont 

1.187x10-*  1556x11)-*  4429x10- 

A  y-Cont 

1.187  xlO"1'  2.387  x  10—  6.084  xlO— 

Dyn,  y(0)  =  O 

1.187x10-*  2.906x10-*  4.129  x  10— 

Dyn,  y(0)  =  u 

1.187x10-*  2.387x10—  6.084  xlO— 

Table  2:  Values  of  cost  functions  for  the  three  experiments. 
The  global  cost  minimum  (Anneal)  is  also  included. 


tablish  a  baseline  result,  a  solution  we  believe  to  be  the  global 
minimum  solution  of  the  RWS  was  calculated  with  a  simulated 
annealing  algorithm.  Table  1  shows  the  network  parameters 
used  for  the  three  experiments.  The  value  of  0  was  fixed  at 
2  x  10*  for  all  experiments  except  the  /^-continuation,  in  which 
it  was  increased  from  0  to  2  x  10*. 

Solutions  obtained  by  the  different  nonlinear  networks  can 
be  compared  as  follows: 

1.  Given  a  cost  function,  construct  the  corresponding  nonlin¬ 
ear  networks,  and  in  addition,  construct  a  corresponding 
RWS  network; 

2.  Provide  each  network  with  the  same  input  and  allow  each 
network  to  attain  its  solution; 

3.  For  each  nonlinear  network,  transfer  the  line  process  solu¬ 
tion  obtained  to  the  RWS  network  by  setting  the  switches 
accordingly; 

4.  Allow  the  RWS  to  attain  its  voltage  solution  and  compute 
the  resulting  coet  —  it  is  this  cost  that  is  used  for  purposes 
of  comparison. 

By  doing  this,  we  measure  how  well  the  network  solves  the 
original  problem  (1),  and  in  addition  are  provided  with  a  uni¬ 
form  method  for  comparing  the  solutions  obtained  by  different 
networks. 

Table  2  shows  the  values  of  the  costs  (calculated  as  de¬ 
scribed  above)  for  the  three  experiments.  In  every  case,  the 
/3-continuation  network  produced  the  same  cost  and  the  same 
solution  as  the  annealing  algorithm.  We  ran  many  more  exper¬ 
iments  than  are  included  here,  but  the  /3-continuation  always 
found  the  same  minimum  as  the  annealing  algorithm.  Al¬ 
though  this  is  not  a  proof  of  optimality  for  the  /3-continuation, 
it  does  indicate  that  if  one  is  trying  to  deterministically  min¬ 
imize  a  cost  function  such  as  in  (1),  the  ^-continuation  per¬ 
forms  extremely  well. 

If  the  cost  function  were  the  last  word  on  image  smooth¬ 
ing  and  segmentation,  we  could  immediately  recommend  the 
/3-continuation.  However,  the  qualitative  results  of  the  exper¬ 
iments  say  otherwise.  We  do  not  have  sufficient  space  to  show 
enough  figures  to  effectively  convey  the  different  behaviors  of 
the  networks.  However,  observe  Figures  11  and  12,  which  are 


Figure  11:  Network  solution  corresponding  to  global  cost  min¬ 
imum  in  experiment  3. 


Figure  12:  Network  solution  obtained  by  Ay-continuation  in 
experiment  3. 


solutions  obtained  from  Expt  3.  The  'former  is  the  global  op¬ 
timal  solution,  yet  it  is  a  completely  smoothed  “blob"  which 
retains  none  of  the  edge  information  contained  in  the  original 
image.  The  latter  figure  was  produced  by  the  Ay-continuation. 
Although  this  solution  does  not  correspond  to  the  global  cost 
minimum,  in  a  visual  sense  it  is  the  best  solution  since  the 
original  input  image  has  been  completely  recovered. 

Naturally,  this  calls  into  question  the  entire  cost  function 
methodology  used  for  smoothing  and  segmentation.  This  dif¬ 
ficulty  arises  because  in  trying  to  compute  a  minimizing  so¬ 
lution  to  a  given  cost  function,  we  are  concentrating  on  only 
one  portion  of  a  larger  problem.  The  total  problem  can  be 
formulated  in  the  following  top-down  manner: 

1.  What  is  the  best  form  of  cost  function  to  use  for  a  given 
vision  task  (in  our  case  smoothing  and  segmentation)? 

2.  What  is  the  best  set  of  parameters  for  the  cost  function? 

3.  What  is  the  best  (minimizing)  solution  to  the  parameter¬ 
ized  cost  function? 

Solving  3  without  giving  enough  attention  to  1  and  2  can  pro-* 
duce  useless  results,  as  the  third  experiment  demonstrates. 

Some  interesting  properties  of  the  Ay -continuation  network 
must  be  mentioned.  For  0  <  cc,  it  can  be  shown  that  there  ex¬ 
ist  a  Am<n  >  0  and  a  Am„  <  oo  such  that  for  Ay  >  A^,  and 


for  \/  <  Amin,  the  network  haa  a  unique  solution.  In  fact, 
for  A/  >  A the  output  will  essentially  match  the  input 
(i.e.,  y  as  u),  whereas  for  A/  <  Xmin,  the  output  will  contain 
no  edges.  Consider  the  network  behavior  as  a  function  of  A / 
as  Ay  is  varied  continuously  from  AM,  to-Amjn.  The  initial 
solution  of  the  network  will  closely  match  the  input.  Then, 
as  Ay  is  decreased,  edges  will  begin  to  disappear,  (first  the 
smaller,  then  the  larger),  until  all  the  edges  are  gone.  In  other 
words,  Ay  acts  as  a  scale-space  parameter.  This  has  impor¬ 
tant  practical  applications.  The  network  of  Perona  and  Malik 
has  the  property  that  time  acts  as  a  scale-space  parameter.  In 
contrast,  we  can  exercise  direct  control  over  the  scale-space  pa¬ 
rameter  in  the  A y-continuation  network.  Finally,  it  turns  out 
that  when  the  edges  disappear  as  Ay  is  varied,  they  disappear 
in  a  catastrophic  fashion.  Investigation  of  the  A y  network  in 
a  bifurcation  theory  framework  is  a  topic  of  ongoing  research. 

5  Conclusion 

In  this  paper,  we  developed  and  compared  a  series  of  nonlinear 
networks  for  image  smoothing  and  segmentation.  The  results 
of  several  experiments  indicate  that  the  typical  cost  (or  en¬ 
ergy)  function  minimization  formulation  of  the  smoothing  and 
segmentation  problem  does  not  necessarily  capture  the  essence 
of  the  task.  For  the  specific  parameter  values  we  used,  the  Ay- 
continuation  network  performed  extremely  well  even  though 
it  did  not  always  find  the  solution  with  minimum  cost.  The 
Ay -continuation  network  has  several  implementation  advan¬ 
tages  over  the  /^-continuation  network.  First,  in  certain  cases, 
it  seems  to  perform  the  smoothing  and  segmentation  task  in 
a  more  visually  correct  fashion.  Second,  Ay  can  be  used  as 
a  scale-space  parameter.  Finally,  since  the  Ay-continuation 
only  requires  that  a  linear  resistance  be  varied,  its  VLSI  im¬ 
plementation  should  be  much  more  compact  than  that  of  the 
^-continuation  (which  would  require  that  the  characteristics 
of  a  nonlinear  resistor  be  varied). 
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